Body movement to sound interface with vector autoregressive hierarchical hidden Markov models
نویسندگان
چکیده
Interfacing a kinetic action of a person to an action of a machine system is an important research topic in many application areas. One of the key factors for intimate human-machine interaction is the ability of the control algorithm to detect and classify different user commands with shortest possible latency, thus making a highly correlated link between cause and effect. In our research, we focused on the task of mapping user kinematic actions into sound samples. The presented methodology relies on the wireless sensor nodes equipped with inertial measurement units and the real-time algorithm dedicated for early detection and classification of a variety of movements/gestures performed by a user. The core algorithm is based on the approximate Bayesian inference of Vector Autoregressive Hierarchical Hidden Markov Models (VARHHMM), where models database is derived from the set of motion gestures. The performance of the algorithm was compared with an online version of the K-nearest neighbours (KNN) algorithm, where we used offline expert based classification as the benchmark. In almost all of the evaluation metrics (e.g. confusion matrix, recall and precision scores) the VAR-HHMM algorithm outperformed KNN. Furthermore, the VAR-HHMM algorithm, in some cases, achieved faster movement onset detection compared with the offline standard. The proposed concept, although envisioned for movement-to-sound application, could be implemented in other human-machine interfaces.
منابع مشابه
An Empirical Study of Dynamic Bayesian User Modeling with Stochastic Processes
Six topologies of dynamic Bayesian Networks are evaluated for predicting the future user events: (1) Markov Chain of order 1, (2) Hidden Markov Model, (3) autoregressive Hidden Markov Model, (4) factorial Hidden Markov Model, (5) simple hierarchical Hidden Markov Model and (6) tree structured Hidden Markov Model. Goal of the investigation is to evaluate, which of these models has the best fit f...
متن کاملBayesian time series classification
This paper proposes an approach to classification of adjacent segments of a time series as being either of classes. We use a hierarchical model that consists of a feature extraction stage and a generative classifier which is built on top of these features. Such two stage approaches are often used in signal and image processing. The novel part of our work is that we link these stages probabilist...
متن کاملStock Returns and Real Growth: A Bayesian Nonparametric Approach
The study of the joint dynamic behavior between stock market returns and real economic growth rates is an important empirical question in finance and macroeconomics. This paper investigates their linkage by proposing a vector autoregressive infinite hidden Markov model. Our model has two advantages over the existing approaches in the literatures. In contrast to Markov switching models with fixe...
متن کاملNonlinear mixture autoregressive hidden Markov models for speech recognition
Gaussian mixture models are a very successful method for modeling the output distribution of a state in a hidden Markov model (HMM). However, this approach is limited by the assumption that the dynamics of speech features are linear and can be modeled with static features and their derivatives. In this paper, a nonlinear mixture autoregressive model is used to model state output distributions (...
متن کاملParameter estimation for non-Gaussian autoregressive processes
It is proposed to jointly estimate the parameters of nonGaussian autoregressive (AR) processes in a Bayesian context using the Gibbs sampler. Using the Markov chains produced by the sampler an approximation to the vector MAP estimator is implemented. The results reported here used AR(4) models driven by noise sequences where each sample is iid as a two component Gaussian sum mixture. The result...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1610.08450 شماره
صفحات -
تاریخ انتشار 2016